Web Survey Bibliography
Title Comparing Web Surveys and Paper & Pencil Surveys: Measurement Error and Mode Differences
Author Fuchs, M.
Year 2002
Access date 21.04.2004
Abstract Based on the increasing methodological research web surveys are increasingly adopted by survey researchers. In terms of the validity of web surveys early studies suggested that--controlling for other sources of survey error--little differences are to be expected in terms of response distributions. However, little insight is available regarding the cognitive processes at work in a respondent's mind when answering a survey question on the internet. We assume that the cognitive capacity available when answering a survey question is impaired by the respondent's navigational efforts when working though the questionnaire. This would harm data quality. In order to assess the cognitive processing of a web survey we use well documented question order and response order experiments from the literature and administer them both under web survey conditions as well as under paper and pencil conditions. We aim to demonstrate that it is not sufficient to compare response distributions when evaluating differences of web surveys and paper and pencil surveys. In this talk we present results from a large scale field experiment (n = 5,000) on measurement error in a mixed mode survey (p & p and online) among the German youth conducted in spring of 2001. In this survey, 6 experiments on measurement error were incorporated: 2 experiments on question order, 2 experiments on response categories, and 2 experiments on response order in long lists.
Abstract - optional Nachdem die Methodenforschung sich relativ gründlich mit einzelnen Problemen und Aspekten von Online-Umfragen beschäftigt hat, werden sie mittlerweile in großem Stil in der Umfrageforschung eingesetzt. Erste vorliegende Vergleiche haben gezeigt, dass die online gewonnenen Daten sich nicht dramatisch von offline gewonnenen Ergebnissen unterscheiden. Weniger erforscht ist bisher jedoch, ob die kognitiven Prozesse des Befragten bei Beantworten einer Fragebogen-Frage im Internet mit denen vergleichbar sind, die bei der Beantwortung eines Papier-Fragebogens auftraten. Wir vermuten, dass die kognitive Kapazität des Befragten bei der Bearbeitung eines Online-Fragebogens durch die Navigation und andere Aspekte belastet werden, was die Datenqualität beeinträchtigen würde. Um die kognitiven Prozesse bei der Beantwortung der Fragebogen-Fragen zu untersuchen haben wir in der Literatur gut dokumentierte Experimente zur Fragereihenfolge und zur Antwortreihenfolge sowohl in einer Online-Befragung wie auch in einer schriftlichen Befragung administriert. Die Ergebnisse zeigen, dass die kognitiven Prozesse beim Befragten bei Online-Umfragen variieren und dass es zur Evaluation der Validität von online gewonnenen Daten nicht ausreicht Antwortverteilungen von Web-Umfragen und schriftlichen Befragungen zu vergleichen. Im Vortrag werden Ergebnisse eines groß angelegten Feld-Experimentes (n= 5.000) zu Messfehlern in Multi-Mode-Befragungen (Paper & Pencil und Online) referiert, die im Frühjahr 2001 unter deutschen Jugendlichen durchgeführt wurde. In diese Umfrage wurden 6 Experimente zur Fragereihenfolge, zur Antwortreihenfolge und zu Skalen-Effekten eingebaut, deren Ergebnisse vergleichend referiert werden sollen.
Access/Direct link Homepage - conference (abstract)
Year of publication2002
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography (4086)
- Displaying Videos in Web Surveys: Implications for Complete Viewing and Survey Responses; 2017; Mendelson, J.; Lee Gibson, J.; Romano Bergstrom, J. C.
- Using experts’ consensus (the Delphi method) to evaluate weighting techniques in web surveys not...; 2017; Toepoel, V.; Emerson, H.
- Mind the Mode: Differences in Paper vs. Web-Based Survey Modes Among Women With Cancer; 2017; Hagan, T. L.; Belcher, S. M.; Donovan, H. S.
- Answering Without Reading: IMCs and Strong Satisficing in Online Surveys; 2017; Anduiza, E.; Galais, C.
- Ideal and maximum length for a web survey; 2017; Revilla, M.; Ochoa, C.
- Social desirability bias in self-reported well-being measures: evidence from an online survey; 2017; Caputo, A.
- Web-Based Survey Methodology; 2017; Wright, K. B.
- Handbook of Research Methods in Health Social Sciences; 2017; Liamputtong, P.
- Lessons from recruitment to an internet based survey for Degenerative Cervical Myelopathy: merits of...; 2017; Davies, B.; Kotter, M. R.
- Web Survey Gamification - Increasing Data Quality in Web Surveys by Using Game Design Elements; 2017; Schacht, S.; Keusch, F.; Bergmann, N.; Morana, S.
- Effects of sampling procedure on data quality in a web survey; 2017; Rimac, I.; Ogresta, J.
- Comparability of web and telephone surveys for the measurement of subjective well-being; 2017; Sarracino, F.; Riillo, C. F. A.; Mikucka, M.
- Achieving Strong Privacy in Online Survey; 2017; Zhou, Yo.; Zhou, Yi.; Chen, S.; Wu, S. S.
- A Meta-Analysis of the Effects of Incentives on Response Rate in Online Survey Studies; 2017; Mohammad Asire, A.
- Telephone versus Online Survey Modes for Election Studies: Comparing Canadian Public Opinion and Vote...; 2017; Breton, C.; Cutler, F.; Lachance, S.; Mierke-Zatwarnicki, A.
- Examining Factors Impacting Online Survey Response Ratesin Educational Research: Perceptions of Graduate...; 2017; Saleh, A.; Bista, K.
- Usability Testing for Survey Research; 2017; Geisen, E.; Romano Bergstrom, J. C.
- Paradata as an aide to questionnaire design: Improving quality and reducing burden; 2017; Timm, E.; Stewart, J.; Sidney, I.
- Fieldwork monitoring and managing with time-related paradata; 2017; Vandenplas, C.
- Interviewer effects on onliner and offliner participation in the German Internet Panel; 2017; Herzing, J. M. E.; Blom, A. G.; Meuleman, B.
- Interviewer Gender and Survey Responses: The Effects of Humanizing Cues Variations; 2017; Jablonski, W.; Krzewinska, A.; Grzeszkiewicz-Radulska, K.
- Millennials and emojis in Spain and Mexico.; 2017; Bosch Jover, O.; Revilla, M.
- Where, When, How and with What Do Panel Interviews Take Place and Is the Quality of Answers Affected...; 2017; Niebruegge, S.
- Comparing the same Questionnaire between five Online Panels: A Study of the Effect of Recruitment Strategy...; 2017; Schnell, R.; Panreck, L.
- Nonresponses as context-sensitive response behaviour of participants in online-surveys and their relevance...; 2017; Wetzlehuetter, D.
- Do distractions during web survey completion affect data quality? Findings from a laboratory experiment...; 2017; Wenz, A.
- Predicting Breakoffs in Web Surveys; 2017; Mittereder, F.; West, B. T.
- Measuring Subjective Health and Life Satisfaction with U.S. Hispanics; 2017; Lee, S.; Davis, R.
- Humanizing Cues in Internet Surveys: Investigating Respondent Cognitive Processes; 2017; Jablonski, W.; Grzeszkiewicz-Radulska, K.; Krzewinska, A.
- A Comparison of Emerging Pretesting Methods for Evaluating “Modern” Surveys; 2017; Geisen, E., Murphy, J.
- The Effect of Respondent Commitment on Response Quality in Two Online Surveys; 2017; Cibelli Hibben, K.
- Pushing to web in the ISSP; 2017; Jonsdottir, G. A.; Dofradottir, A. G.; Einarsson, H. B.
- The 2016 Canadian Census: An Innovative Wave Collection Methodology to Maximize Self-Response and Internet...; 2017; Mathieu, P.
- Push2web or less is more? Experimental evidence from a mixed-mode population survey at the community...; 2017; Neumann, R.; Haeder, M.; Brust, O.; Dittrich, E.; von Hermanni, H.
- In search of best practices; 2017; Kappelhof, J. W. S.; Steijn, S.
- Redirected Inbound Call Sampling (RICS); A New Methodology ; 2017; Krotki, K.; Bobashev, G.; Levine, B.; Richards, S.
- An Empirical Process for Using Non-probability Survey for Inference; 2017; Tortora, R.; Iachan, R.
- The perils of non-probability sampling; 2017; Bethlehem, J.
- A Comparison of Two Nonprobability Samples with Probability Samples; 2017; Zack, E. S.; Kennedy, J. M.
- Rates, Delays, and Completeness of General Practitioners’ Responses to a Postal Versus Web-Based...; 2017; Sebo, P.; Maisonneuve, H.; Cerutti, B.; Pascal Fournier, J.; Haller, D. M.
- Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary...; 2017; Meitinger, K.
- Nonresponse in Organizational Surveying: Attitudinal Distribution Form and Conditional Response Probabilities...; 2017; Kulas, J. T.; Robinson, D. H.; Kellar, D. Z.; Smith, J. A.
- Theory and Practice in Nonprobability Surveys: Parallels between Causal Inference and Survey Inference...; 2017; Mercer, A. W.; Kreuter, F.; Keeter, S.; Stuart, E. A.
- Is There a Future for Surveys; 2017; Miller, P. V.
- Reducing speeding in web surveys by providing immediate feedback; 2017; Conrad, F.; Tourangeau, R.; Couper, M. P.; Zhang, C.
- Social Desirability and Undesirability Effects on Survey Response latencies; 2017; Andersen, H.; Mayerl, J.
- A Working Example of How to Use Artificial Intelligence To Automate and Transform Surveys Into Customer...; 2017; Neve, S.
- A Case Study on Evaluating the Relevance of Some Rules for Writing Requirements through an Online Survey...; 2017; Warnier, M.; Condamines, A.
- Estimating the Impact of Measurement Differences Introduced by Efforts to Reach a Balanced Response...; 2017; Kappelhof, J. W. S.; De Leeuw, E. D.
- Targeted letters: Effects on sample composition and item non-response; 2017; Bianchi, A.; Biffignandi, S.